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1^ ' , Abstract 

In this paper we obtain a new family of identities for random measures on the 
• unit ball of a separable Hilbert space which arise as the asymptotic analogues of the 

, Gibbs measures in the Sherrington-Kirkpatrick and p-spin models and which are known 

to satisfy the Ghirlanda-Guerra identities. We give several applications of the new 
identities to structural results for such measures. 
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g : 1 Introduction and main results. 

The Gibbs measures in the Sherrington-Kirkpatrick type spin glass models are known to 
satisfy two asymptotic stability properties - the Aizenman-Contucci stochastic stability [1] 
^ ■ and the Ghirlanda-Guerra identities |5J. These properties are typically proved by adding a 

^ ! small perturbation term to the Hamiltonian of the model (see [19], [20]), but in some cases 

can be proved in a strong sense without perturbation (see [3], [9]) using the validity of the 
Parisi formula and its properties ([6], [17], [H]). In this paper, we will prove a new invariance 
property for asymptotic Gibbs' measures that satisfy the Ghirlanda-Guerra identities. Even 
though the idea behind the main result. Theorem [T] below, was originally motivated by the 
stability property proved in [TT] which unified the Aizenman-Contucci stochastic stability 
and the Ghirlanda-Guerra identities, the proof given here is based only on the Ghirlanda- 
Guerra identities. As one application of the new invariance, we will show how one can reduce 
the problem of ultrametricity to a formally weaker condition on the size of non-ultrametric 
set. As another application, we will prove that one can always find infinite sequence of points 
in the support of the measure such that all their overlaps take values in a given set of overlaps 
of positive probability. This, for example, implies the positivity principle of Talagrand (|16j. 
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[20] or [7]) and the fact that the support of such measure is not totally bounded. For discrete 
measure that satisfies the Ghirlanda-Guerra identities we will show that the Gram matrix of 
the points in its support is weakly exchangeable and independent of the weights. Finally, we 
will give a couple of examples of new identities for the Poisson-Dirichlet distribution PD{(). 

Let us consider a random probability measure G on the unit ball of a separable Hilbert 
space H. We will denote by (cr');>i an i.i.d. sequence from this measure, by (■) the average 
with respect to and by E the expectation with respect to the randomness of G. Let 

= cr^ ■ o''' be the scalar product, or overlap, of cr' and cr' . Random measure G is said to 
satisfy the Ghirlanda-Guerra identities if for any n > 2, any bounded measurable function 
/ of the overlaps {Rij')i^i'<n and any bounded measurable function ip of one overlap we have 

1 1 " 

E(/V^(/?i,„+i)) = -E(/)E(^(i?i,2)) + - VE(/V^(i?i,0)- (1-1) 
n n ^-^ 

1=2 

Another way to express the Ghirlanda-Guerra identities is to say that, conditionally on 
{Ri,i')i<i<i'<n, the law of Ri^n+i is given by the mixture 

n 

(1.2) 

1=2 

where [i is the law of R\^2 under the measure EG"^^. Given n > 1, consider n bounded 
measurable functions /i, ...,/„ : ]R"("'~i)/2 x R — )■ M and define 

F(a, G\...,a^) = h{R^, a ■ a^) + . . . + UR\ a ■ a") (1.3) 

where we denoted i?" = {Ri^v\<x'<n- For 1 < Z < n we define 

F,(a, a\ . . . , a") = F(a, a\ . . . , a") - /z(i?", a ■ a') + J fi{R\ x) dfi{x) (1.4) 

and for / > n + 1 we define 

FKa,a\...,a") = F(a,a\...,a"). (1.5) 

This definition fll.51) for I > n + 1 will not be used in the statement but will appear in the 
proof of our main result. 

Theorem 1. Suppose ( fi.ip holds and let ^ be a bounded measurable function of R^. Then 

^/<l>expV" F,(a',crS...,cr")\ , , 

E($ =E( — /^ir/ ' — '—^ — 1.6 
^ ' \ (expF(a,ai,...,cr"))^ /' ^ ' 

where the average (■)_ in the denominator is in a only for fixed a^, . . . and the outside 
average of the ratio is in , . . . . 
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When n = 1, it is understood that $ is a constant. Notice that one can easily recover the 
original Ghirlanda-Guerra identities from (11. 6p by taking f\ = tip and /2 = ••• = /«= and 
computing the derivative at t = 0. One can generalize Theorem [T]by iteratively applying the 
principle behind its proof to the new coordinates and we will describe this generalization in 
Theorem [5] in Section O Classical form of the Ghirlanda-Guerra identities (II. ip has been used 
successfully to prove several results about the structure of random measures that satisfy these 
identities (see e.g. [12] and Chapter 12 in [20]) and we will use the information contained 
in the new representation (II. 6p to prove some new structural results about these measures. 
The ultimate goal would be to show that such measures must be ultrametric, generalizing 
the results in [8], [lO] and [19] (inspired by p]) and our next result makes a small step in 
this direction. Measure G is said to be ultrametric if for any q, 

G'^^{{{a\a',a^) : R,^2 > q,Ri,3 > q,R2,3 < q}) = 0. (1.7) 

Another way to express (II. 7p is to say that for any two points a^, cr^ sampled from G such 
that Ri^2 = (y^ ■ (y^ > q the sets 

A{a^, a"^) = [a : a ■ > q, a ■ < q] , 

A'(a\ a^) = {a : a ■ (T^ < g, a • (T^ > g} (1.8) 

have measure zero. The first application of the identities of Theorem [1] is the following result 
which says that if one can show that the measure of A(cr^, a^) is not too big in some sense 
then (II. 7p holds with probability one. 

Theorem 2. Suppose that holds. If 



then (1.1) holds with probability one. 



If the measure G is ultrametric then G(yl(cr^, cr^)) = and the above integral is equal to 
/i([g, 1]) = E(/(_Ri^2 > q))- Of course, in a given model it might be just as difficult to 
prove (II. 9p as to prove ultrametricity but formally this condition is weaker and Theorem [2] 
illustrates a new possible direction opened by Theorem [H Let us now define 

1 " 

F(a, a\ . . . , a") = F(a, a\ . . . , a") - - ^ Fi{a\ a\ . . . , a"). (1.10) 



n 
1=1 



Another consequence of Theorem [T] is the following. 

Theorem 3. Under M.l\) . for any n > 1, with probability one over the choice of measure G 
and for G^'^-almost all (a^, . . . , a"), the measures of the sets {a : F{a, a^, . . . , a") > 0} and 
{a : F{a, a^, . . . , a"') < 0} are either both positive or both equal to zero at the same time. In 
particular, the inequalities F >0 and F < hold on the sets of positive measure G. 
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Let us give several examples of application of Theorem [31 First, let us apply it to the case 
of n = 2 and the functions = I{x G C) and f2{R'^,x) = — /(x G C) for a given set 

C. If we denote 

C{a\ a^) = {a -.a-a^ eC,a-a^ ^C}, 

C'{a\ a^) = {a:a-a^ ^C,a-a^ eC} (1.11) 

then f ll.lOp can be written in this case as F{a, a^, a^) = /(a G C((t\ cr^)) — /(cr G C"((J^, cr^)) 
and Theorem |3] implies that the measures of the sets C{a^, a^) and C'{a^, a^) are either both 
positive or both equal to zero at the same time. In particular, the measures G{A{a^,a^)), 
G{A'{a^, 0"^)) of the sets in (11. 8p are either both positive or both equal to zero. 

Another application of Theorem [3] is as follows. Let us take sets Bi for / < n such that at 
least one /i(-B;) > and let us make the choice of functions /;(/?"", x) = I{x ^ Bi). Consider 
any sample a^, . . . , cr" from the measure G such that Ri^v G Bi (1 Bi' for all / ^ I'. Then 
fi{R^, Ri,i') = for all / 7^ /' and the condition F < becomes 

^/(a.a'^BO<^E'"((^')^)- 

l<.n l<n 

If at least one fi{Bi) > 0, the right hand side is strictly less than one and the condition is 
satisfied only if all a ■ a'' E Bi. Thus, we get the following. 

Corollary 1. Suppose at least one ^{Bi) > 0. Under ( fi.ij) . for G^'^-almost all [a-^, . . . , cr"), 
if Ri,i' (z Bi n Bi' for all I ^ I' then on a set of positive measure G , a ■ a'' E Bi for all I < n. 

If i? is a set with ^{B) > then using Corollary [T] inductively on n we can find an infinite 
sequence (cr') in the support of G such that all overlaps Ri^ir G -B. It is known (Theorem 2 in 
[8]) that if the measure G satisfies the Ghirlanda-Guerra identities and if q* is the supremum 
of the support of the distribution of the overlap R12 under EG*^^ then with probability one 
G is concentrated on the sphere of radius y/q*. On the other hand, if E(/(i?i^2 < ?)) > for 
some q < q* then taking i? = [— 1, g] we can find infinite sequence (cr') in the support of G 
such that all overlaps Ri^i' < q. This means that if the distribution of R12 is not concentrated 
on one point q* then the support of G on the sphere of radius ^/q* contains infinitely many 
points at some positive distance from each other, which implies the following. 

Corollary 2. Under U.l\) . if fi{{q*}) < 1 then with probability one the support of G is not 
totally bounded. 

In a related result, it was proved in [3] that under the Aizenman-Contucci stochastic stability 
the support of the measure is not finite dimensional. As another application, using Corollary 
[1] inductively as above with the choice of B = [—1, —e] we can recover the positivity principle 
of Talagrand (see [16],|20] or [7]) which states that under (11. ip . we must have /i([— 1, 0)) = 0. 
Indeed, if /i([— 1, —£]) > then we can find an infinite sequence (cr') in the support of G such 
that all overlaps Ri^ir < —e which is impossible since 

< II 5]]fT'f = ^ Ri^i, <n-n{n-l)£ <{) (1.12) 

l<n l,l'<n 
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for n large enough. This argument gives us an opportunity to emphasize the strength of 
Corollary [1] and Theorem [1] by comparing it with the following very elementary proof of 
positivity principle pointed out to the author by Michel Talagrand. Given a set B, let us 
define the event 

Bn = {Ri^v e B for all l^l' <n} 

and notice that 

> /b„ -Y.lBj{Rl,n+l i B). (1.13) 

l<n 

The Ghirlanda-Guerra identities (11. ip imply that 

E{lBj{Rl,n+l^B)) = ^E{lB„) 

and using ffLTS]) we get E{Ib,,+,) > h{B)W.{Ib„) and, by induction, E(/b„+,) > /i(5)". If 
/i(i?) > then with positive probability over the randomness of G, n replicas cr^, . . . ,0""^ 
sampled from G belong to the set i?„ with positive probability. Taking B = [—1,—e] and 
appealing to (I1.12p shows that /i([— 1,— £:]) must be zero, which proves that /i([— 1,0)). On 
the other hand, in the same situation when /i(-B) > 0, Corollary [1] gave us the same statement 
with probability one over the randomness of the measure G and, moreover, guaranteed that 
we can find a vector (cr^, . . . , cr") G Bn with all coordinates in the support of G starting from 
any a^, which is a significantly stronger statement. 

Our next application of Theorem [1] will be for discrete random measures on the Hilbert 
space H that satisfy the Ghirlanda-Guerra identities. Suppose that G = J2i>i "^i^ii some 
random weights (vi) and random elements (^;) on the unit ball of H and assume that G 
satisfies (11.11) . We assume that the weights (vi) are arranged in non-increasing order and 
denote hj Q = (^/ ■ C,i')i,i'>i the Gram matrix of scalar products of the points in the support 
of G. The matrix Q is called weakly exchangeable if 

iU) ■ U')) = i^i ■ ^i'h'>i (1-14) 

for any permutation p of finitely may indices. We will prove the following. 

Theorem 4. Under ( (i.ij) . the Gram matrix Q = {^i ■ C,i')i,i'>i is weakly exchangeable and 
independent of the weights (vi). 

Exchangeability of Q under (11.11) was proved before in Theorem 3 in [S] by way of invariance 
properties of G under some random changes of density and here we will give a different proof 
as an application of Theorem [1] (in the form of Theorem [7] below). Independence of [vi) and 
Q under the assumption (II. ip is a new result motivated by Theorem 4.2 in [2] where it was 
proved under a different assumptions of robust quasi-stationarity and ergodicity of G under 
a family of random changes of density. The corresponding argument in [2] is very subtle and, 
even though the proof of Theorem H] will require some work, we hope that in the end it is 
much more intuitive. Of course. Theorem H] was also motivated by the fact that this property 
holds in the ultrametric case of the Ruelle probability cascades [13] (see [1]). 
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Finally, let us mention that (11. 6p seems new even for the simplest measures satisfy- 
ing (11.11) in which case it can be written as a family of identities for the Poisson-Dirichlet 
distribution PD{() and we will state a couple of such identities in Section [3l 

Acknowledgement. The author would like to thank Michel Talagrand for a number of 
helpful comments and, in particular, for pointing out an elementary proof of the positivity 
principle and the fact that the functions /; in Theorem [1] can depend on i?". 



2 Invar iance principles. 

Before we prove Theorem [H let us formulate a generalization which is obtained by iterating 
the same idea in a certain sense. Consider integers r > 1 and 1 < rii < n2 < ■ ■ ■ < rir and 
for p < r consider sets 

/p = + 1, . . . , rip} 

where no = 0. The partition (Jp) represents r groups of coordinates from {l,...,n}. For 

p < r, let R^p = (Ri^i,) 

i<i',i,i'eip denote the array of overlaps of coordinates in Ip and for 
/ G Ip let us consider functions fi{R^p,x) of R^p and x G M. For simplicity of notations we 
will sometimes keep the dependence of /; on R^p for / G Ip implicit and simply write fi{x). 
For p < r, we define 

FP{a, a\..., a"^) = f,{a ■ a') + . . . + ■ a"-) (2.1) 
and then define for I E Ip, 

Ff{a, a\..., a'^p) = F^{a, a\ . . . , a^^) - fiiR^", a ■ a') + jfi{R'-,x) rf/x(x), (2.2) 

and for I ^ Ip, 

Ff{a,a\...,a'^p) = F^{a,a\...,a-p). (2.3) 

For p < r, let us define 

^ ' ' ^ (expFP(cT,ai,...,a"f))[^fl ^ ' 

where, as in Theorem [H (■)_ is the average in a only. The following holds. 
Theorem 5. Suppose U.l\) holds and ^ is a bounded measurable function of R^^ . Then 

E($) = E(Z^..Z''$). (2.5) 

Theorem [1] corresponds to the case of the one element partition {Ip), i.e. r = 1. It is essential 
that the function $ in (12. 5p depends only on the coordinates in the last group J^. Note also 
that, using replicas, one can rewrite 
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where the average (■)_ in the denominator is in the new coordinates (pi). 

Proof of Theorem [H Without loss of generahty, let us assume that $ takes values in [0, 1] 
and suppose that |//| < L for 1 < / < n for some large enough L. For t > let 

^(i)=E(i^2i%^^i^I>^^\. (2.7) 

^ \ (exp^F(a,a^...,a'^))^ / ^ ' 

We will show that the Ghirlanda-Guerra identities (11. ip imply that this function is constant, 
thus, proving the statement of the theorem, (p{0) = ^p{l). If for k > 1 we denote 

n+k-l 

Z)„+fc= i^^(o^^or^...,a")-(n + A;-l)F„+,((T"+^(T^...,a") 

1=1 

then one can easily compute by induction that (recall fll.Sp and that we average in a only 
in the denominator of fll.6p ) 

{k)(^^ = "^^"^^ • • • ^"=^^ ^^'^"^'^ ^^ • • • ^ 

^ ^ \ (exptF((T,(T^...,a"))^+^ 

First, let us notice that ip^''\0) = 0. Indeed, if we denote $' = $Di . . . Ai+fc-i then $' is the 
function of the overlaps (i?/^//)/^//<„+fc_i and 

n+fe-l 

(k) 



(0) = e($' ( J2 a\ . . . , a") - (n + A; - a\ . . . , a")) ) (2i 

1=1 

n n+k—1 „ 

.7 = 1 «7^7 



by the Ghirlanda-Guerra identities in the form of (11.20 applied to each term j. Now, since 
\Fi\ < Ln and l-Dn+ytl < 2L{n + k — l)n we get 



i,<m < (n2M"-'-i)")Ki5^.,. ....... 



11 ^ W \ (exptF(a,ai,...,a")): 

fc 

= n^^ + ^~^)^2Ln)V(t)- 

Consider arbitrary T > 0. Again, using that \Fi\ < Ln it is obvious that (f{t) < e^^-^"^ for 
<t <T and, therefore, 
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By (12.81) and Taylor's expansion 

Letting A; — )■ oo we get that (p{t) = ip{0) for t < {2Ln)^^. Therefore, for any < {2Ln)~^ 
we again have (p^''\to) = for all A; > 1 and by Taylor's expansion for to < t < T, 

\^{t) - ^{to)\ < max _ < e^"^"^ ^"t^~^f (2Ln(t - t,))K 

to<s<t kl k\ [n — Ij! 

Letting — > oo proves that ip{t) = (p{0) for < t < 2{2Ln)^^. We can continue in the same 
fashion to prove this equality for all < t < T and note that T was arbitrary. 

□ 

Proof of Theorem [5l The proof is by induction on r. Suppose that (12. 5p is proved for 
some r > 1. In order to make the induction step, we will separate the coordinates in the 
last group Ir into two sets coordinates that will play different roles. Given n > Ur, let us 
apply the induction hypothesis to the partition Ii, . . . , I^-i, Ir where the last set is now 
Ir = Ir^ {rir + 1, . . . , n} = {fir-i + 1, . . . , Ti} and the functions 

= ... = /„ = 0. (2.9) 

Let denote (12.41) corresponding to the set Ir, i.e. 

= Z^ia\ . . . , a") = ^-P^^^/.^^^^V ••'""). (2.10) 
^ ^ (expF-(cr,cri,...,a"))l^-l ^ ' 

Because of ([23]), 

r-{a, a\ a") = /i(a ■ a^) + ... + /„, (a ■ = F^i^r, cr\ . . . , a"' ) 
as in (12.11) for p = r, and for / > n^. 

Therefore, the choice (12. 9p allows us to rewrite (I2.10p as 

This means that for fixed cr^, . . . , a'""' the coordinates a' for I > rir are integrated with respect 
to the product measure 

dG'ia) = /"Pr/"'"/---'"";^, dGja). (2.12) 
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If we denote by (■)' the average over the coordinates (o"')/>„,, with respect to {G')^°° con- 
ditionally on 0"^, . . . , 0""'' and if we choose $ to be the function of the overlaps only on the 
coordinates (cr')„,,<K„, then the induction hypothesis and (12. lip give 

E($) =E(Z^..Z" ($)'). (2.13) 

We can think of . . . as the change of density and treat the functional of $ on the right 
hand side as the probability on the overlaps of the coordinates (cr')i>„^, which again satisfies 
the Ghirlanda-Guerra identities. We can now apply Theorem [1] to (or repeat its proof for) 
this functional to obtain the following. Let n^+i > rir and Ir+i = {ur + 1, . . . ,nr+i}. For 
/ G Ir+i consider functions fi{x) = fi{R^'"+^,x), define 

F{a, . . . , a"^+^) = /„,+i(a ■ a^^+i) + . . . + /„^^^(a ■ a"'-+^) (2.14) 

and for / G Ir+i define 

Fiia, . . . , cr"'-+^) = F(a, . . . , cr^-^^) - fiia ■ a') + J fi{x) rf/i(x). (2.15) 

Then, Theorem [1] (or its proof) applied to the right hand side of fl2.13p implies 

^ ' \ \ ((expF(a,(T"-+i,...,a"'-+i))'_)'^'-+'' // 

where (■)'_ is the average in a only with respect to the measure G' . It remains to rewrite 
fl2.16p recalling the definition of the measure G' in (12.120 . Since 

,n.+i ^n.+nw _ (exp(F(a, . . . , g-'+Q + F-(a, a\..., a"')))_ 



(expF((T, (T"'-+\...,a"'-+i))'_ 



(exp F'-(o-,(t1, . . . ,0-"'-)). 
(exp F"+i(a,a\...,a"'-+i))_ 



(exp F^((T,ai,...,cr"'-))- 



(2.17) 



by (12. ip and (I2.14p . the average (■)' inside (I2.16P over the coordinates ((t');^/^^^ can be 
rewritten as 

^ exp E^g7,.^,(^K^', • • • , ^"-+0 + ^^(^^ • • • , ^"'•)) 
(exp F^'+i ((T, (ji , . . . , cr^^+i ) ) [f^+i I 
^expE.,,.^^Fr^(a^a^...,a"-^0 " ^^^^^ 
(expF'^+i(o-,cTi, . . . ,cr"'-+i))[^'-+il / ^ 

where we combined (12.150 and (12.20 in the numerator and where the average is taken only 
over the coordinates {p^\(^i^j^^- This completes the induction step and finishes the proof. 

□ 

It is worth formulating the general principle expressed in equations (12.121) and (12.131) as a 
separate result. Let (f2, Pr) be the probability space on which the random measure G is 
defined and let H be our Hilbert space. Let Pr^"--) be the measure on f2 x if"'' defined by 
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the change of density . . . Z^ ^ i.e. for any measurable sets ACQ and Ai, . . . , An^ C H, 
probabihty Pr*^"''''(A x Ai x . . . x is given by 

{Z\.. Z''){a\ (t"') dGia^) . . . dG{a''^) dVi{u). (2.18) 

We can think of the random measure G' in (12.121) as defined on {Vt x iJ"'', Pr*^"''-') since it 
depends on u and o"^, . . . , cr""' and (12.131) expresses the following. 

Theorem 6. Under ( fi.il) . t/ie random measure 

/ias ^/ie same distribution as the measure G on (O, Pr) in the sense that i.i.d. samples from 
these measures have the same joint overlap distributions. 

Let us write down another generalization of Theorem [1] in a slightly different direction on 
which our applications will be based. Consider a finite index set A. Given ra > 1 and con- 
figurations cr\ . . . , a", let {Ba)aeA be a partition of the Hilbert space H such that for each 
a & A the indicator /(a G Ba) is a measurable function of i?" and (a ■ (J^)i<n and let 

Wo^ = W^{a\...,a^) = G{B^). (2.19) 

Let us define a map T by 

W = (W„U, nw) ^ ( <^f- '''Pf ■ ■ ■ 'X'^- ) . (2.20) 

V (expF(cr, cr^, . . . , cr"))_ / ae^ 

We have the following invariance result for the weights {Wa) of the random partition (-Bq). 
Theorem 7. Under ( (i.i)) . /or any bounded measurable function ip : x R'"^' — )■ M, 

' " \ (expF(a,ai,...,cT"))^ / ^ ' 

Proof. For each a G ^ let us take integer no, > and let m = n + X^ae^^"- {.Sa)aeA 
be any partition of {n + l,...,m} such that I^qI = ria- Consider a continuous function 
$ : R"("-i)/2 ^ R and let $' = $(/?") where 

¥P„ = /(a'Gfia,V/G^„) 

and let fi ioi I < n be as in (II. 3p and = . . . = = 0. Let us now apply Theorem 
[1] with these choices of functions $' and /; (and n = m). First of all, integrating out the 
coordinates (cr');>„, the left hand side of (11.61) can be written as 

E($') =E($(i?") =E(<l>(i?") J]iy,""(a\...,a")> (2.22) 

aeA aeA 

where W^'s were defined in (12.191) . Let us now compute the right hand side of (II. 6p . Since 
fn+i = • • • = /m = 0, the denominator will be {|exp F{a, a^, . . . , cr")) and 

m n ni 

J2 Fi{^\ a\...,an = Y, Fi{^\ a\...,a-)+Y. F{a\ a\ . . . , a"). (2.23) 

1=1 1=1 l=n+l 
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Since the denominator does not depend on (cr')i>n, integrating in the coordinate cr' for / G Sa 
will produce a factor 

{lB^expFia,a\...,a^))_. 
For each aEAwe have 1 5*0,1 = of such coordinates and, therefore, the right hand side of 



()1.6p is equal to 



^ / ^R-) exp Er=i Fi{a\ a\ . . . , a^) -pr / {Ib^ exp F{a, a\ . . . , 
\ (expF(a,ai,...,a'^))^ J-^H (exp a^, . . . , / /' ^ ' ^ 

Comparing with f l2.22p . recalling fl2.20p and approximating a continuous function (p on [0, 1]''^' 
by polynomials we get ( I2.2ip first for products ^{R"')(j){W), then for continuous functions 
(flK^, W) and then for arbitrary bounded measurable functions. 



3 Applications. 

Let us begin with the following special case of Theorem [71 Let us consider some sets Bi for 
/ < n. Let A be the power set of {1, ... , n} and for each a C {1, . . . , n} we define a set 

Bai(j\ . . . , a") = {a : a • a' ^ 5, ^ / G a} (3.1) 

which depends only on the overlaps. Given t = {ti, . . . ,tn) G M", let us now make the choice 
of functions fii^K^jX) = til{x ^ Bi). Since in this case, using notation = Ylii^^a^h 

F{a, a\...,a^) = Y, tJicr ■ a' ^ B{) = Y, tJ{cr G B^) (3.2) 

l<n aeA 

we get 

{Ib^ exp F{a, a\ . . . , a"))_ = W^e'" (3.3) 

and 

(exp F{a, a\..., a"))_ = ^ W^e'- (3.4) 

aeA 

If we denote At = J2aeA ^a^*" the map T in fl2.20p becomes 

W = {W^Uc{i,...,n} ^ Tt{W) = (3.5) 

V ZAj / Q!C|l,...,n} 

Given a measurable function : M^" — )■ R and an arbitrary subset 

n 

B ^Y[BinBi> C M«("-i)/2^ (3.6) 

take the function ip in fl^:^ to be = /(i?" e E)0(Vr). Since for i?" G S, the overlap 
Ri,i' & BiH Bi' and therefore fi{R^, Ri,v) = 0, we have 

n „ 

Fi{cr\ a\...,a-) = Y,ti jl{x^ Bi) d^i = Y,ti f^mT) =: It- (3.7) 

/=1 l<n l<n 

With these choices of parameters. Theorem [7] becomes: 
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Theorem 8. Under U.l]) . for any bounded measurable function : — )• 



nm''.B),iw))^E{M^^WM}fiy (3.8, 



To show how this imphes Theorem |2l let us consider the following special case with n = 2. 
Consider q'2 < Q'l < < 1 and let Bi = [qi, 1] for / < 2 and B = [q, 1]. The partition (-Bq) 
will now consist of four sets 

Ai{a\ cr'^) = {a : a ■ cr^ > qi, a ■ a'^ < ^2}, 
^2(o-\ a^) = {(T : (T ■ o-^ < gi, (J ■ o-^ > ^2}, 
^3(0-^ a"^) = {a : a ■ > qi, a ■ a"^ > ^2}, 

A4,{a^, a^) = {a : a ■ a'^ < qi, a ■ < 52}- (3.9) 
Let Wj = Wj{a\a^) = G{Aj{a\a^)). With these notations, 

At = Wic'^ + W2e'' +W3 + W4e*l+*^ (3.10) 



the map 



and 7t in f l3.7p is 



r.wH^.^f^,^.^) (3.11) 



7t = tiP(i?i,2 < qi) + t2P(i?i,2 < g2). (3.12) 
Theorem [H] gives that for any bounded measurable function : R'^ — > M, 

Eim,,>,)m)}-E{l^!hi^Mnmsly (3,3) 

This readily implies Theorem |2l 

Proof of Theorem [2]. Let s > 0. Let us use fl3.13p with qi = q2 = q, the choice of function 

(f)(W) = 

^ {Wie-' + W2e-' + W3 + W^y 

and the choice of ti = s,t2 = — s. Then fl3.13p becomes 



{Wic-' + W2e-' + + W^y I \ (Vrie-2^ + 1^2 + + Wif 
Letting s — > 00, by monotone convergence theorem we get 



and condition (11. 9p means that this quantity is finite. In that case, almost surely over the 
choice of random measure G and the choice of (cr^, cr^) from G®^, if cr^ ■ cr^ > g then W2 = 
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G{A2{a^, cr^)) = and by symmetry Wi = 0, which is another way to express fll.7p . 

□ 

Proof of Theorem [31. In the setting of Theorem [TJ let us take a partition consisting of 
three sets 

Bi = {a: F{a,a\...,a'') > O}, B2 = {a : F{a,a\ . . . ,a'') < O} 

and B3 = {El U B2Y. Let Wi = G{Bi) for I < 3. Let us apply flOB to the function 
^{R", W) = I{Wi = 0) and let us replace functions fi by sfi for s > 0. Since {T{W))i = 
if and only if Wi = 0, we have (fi{R", T{W)) = I{Wi = 0) and (l2:2T|) becomes 

^<^'^'^'-°'>-K (expJ('!!lr.°'.,„)>„ )- (3.14) 

Whenever Wi = G{Bi) = 0, we have 

(exp sF{a, a\ . . . , = {Ib, exp sF{a, a\ . . . , + W3 
and since F < on i?2, letting s — ?■ 00 implies by monotone convergence theorem 

E{I{W,=0)) = e{^-^^^^). (3.15) 

This shows that whenever Wi = we must have W3 = 1 and, therefore, W2 = 0. Similarly, 
one can show that whenever W2 = we must have Wi = which means that either both 
Wi and W2 are positive or equal to zero. Of course, this implies that the measures Wi + W3 
of the set F > and W2 + W3 of the set F < are always positive. 

□ 

Let us give a partial generalization of Theorem [3] in the setting of Theorem [5l Recall the 
notations of Theorem |5] and define 

Hip'), (^')) = E E p"(p'^ • • • ' ^"'') -EE ^'(^'' • • • ' ^"^)- (3.16) 

p<r lelp p<r iGlp 

The following holds. 

Theorem 9. Under U.l\) . with probability one over the choice of measure G, for G'^'^''- almost 
all {a^, . . . , cr""') the inequality F > holds on a set of {p^, . . . , p"' ) of positive measure G®""". 

Proof. Let us recall 02.61) and apply Theorem O to the function $ = 1 and with functions fi 
replaced by sfi, 

1 = e( ^ V (3.17) 

\(exp.F((pO,(a')))_/ 

If we consider the set 

B = {ia\ . . . , a-) : G{{ip\ p"') : F((p'), (^0) > 0}) = O} 
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then 



i>e/- 



\(expsF((pO,(cr'))). 



and, since on B the hmit hms_j.oo(exp s-F)_ = 0, we must have ]E(/b) = 0. This means that 
for G'®""'-almost all (cx^ . . . , a"'') the condition F > is satisfied on the set of (p^, . . . , p""') 
of positive measure G®""". 

□ 

Exchangeability and independence. We will now prove Theorem |H First, recall several 
properties of measures G satisfying the Ghirlanda-Guerra identities (11. ip that will be used 
in the proof of Theorem |H We already mentioned in the introduction that if q* is the 
largest point in the support of the distribution of ■ o"^ under EG®^ then f ll.ip implies that 
G(||(t||^ = q*) = 1 with probability one which in the case of discrete measure G = J2i>i '"i^ii 
means that all = q* and, in particular, Ri^2 = (J^ ■ (t^ = q* if and only if = cx^. Also, 
by a well known result of Talagrand (Section 1.2 in [16] or Proposition 15.2.4 in [20]) the 
weights {vi) must have the Poisson-Dirichlet distribution PD{() with C G (0,1). We recall 
that, given ( G (0, 1), if (u/)/>i is the decreasing enumeration of a Poisson point process on 
(0, oo) with intensity measure x~^~'^dx on (0, oo) and vi = ui/ J^j then the distribution of 
the sequence (vi) is called the Poisson-Dirichlet distribution PD{() (see e.g. [13]). We will 
be using the fact that 

E{I{a' . = 1)) = E ^ = 1 - C (3.18) 

i>i 

(see e.g. [H] or Section 13.1 in [20]). When we sample n replicas a^, . . . , cr" from G, some of 
them could be equal so we can divide all indices {1, . . . ,n} = Gi U . . . U Gk into k groups 
Ci, . . . , Cfc such that if and only if / and /' belong to the same element of the 

partition. Let us for a moment fix one such partition and call it G. We will use the same 
notation to define the event 

C = [Ml^l' < n, Ri^v = q* <k such that /, /' G Q}. (3.19) 

Let J = (ji, . . . ,jk) be a vector such that ji is the smallest index in Gi and let us define 

R={a^' .a^i')i,^j^ and W = {G{(j^'), . . . ,G{a^^)). (3.20) 

Let us define the conditional distribution of R and on C by 

P,(«eA.H^-eB)^W4!lM)M. (3.21) 

We will prove the following result from which Theorem H] will easily follow. 
Theorem 10. We have, 

Fc{R eA,WeB)= Fc{R G A) Fc{W G B). (3.22) 
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The main idea of the proof is contained in the computation in Lemma [T]below which is based 
on the invariance principle of Theorem [71 Let 

Wfc = {{wi, . . . ,Wk) -."^wi <l,wi,. . . ,Wk> 0}. (3.23) 

l<k 

Given a vector a = (ai, . . . , Ofe) G let us define Ta : Wk — ?• Wfc by 



where 



^a(^)= -rV^,...,-rV^ (3-24) 
^aiw) = J2 wi^"' + l-Y,wi. (3.25) 

l<k l<k 

One can easily check that for a,b E M.'' we have o Tf, = T^+f, and, therefore, = T_a- 
Also, it is easy to check that 

A,(T_,(uO) = A_,(t/7)-^ (3.26) 

Let us denote by B^{w) an open ball of radius e centered at w. Then the following holds. 

Lemma 1. For any a = (ai, . . . , a^) G M'^ and w G Wk, 

Fc(B. e AW e B j.)) ^ Fc(ReA TAW)e B i.)) 
«o+ ¥c(W€BJw)) .^0+ Pc(T,(W) € BJw)) ^ ' 

whenever either of the limits exists. 

Proof. For simplicity of notation, let us assume that J = (ji, . . . ,jk) = {1, . . . , k}. In fl2.19p 
- fl2:2T]) let us take A = {1, . . . , k + 1}, Bi = {a^} for / < and Bk+i = . . . , a'^Y, 
fi{x) = ail{x = q*) for I < k and // = for / > k. Then our notation Wi = G{Bi) = G'(cr') 
in f l3.20p agrees with f l2.19p for I < k and we will forget about Wk+i = G{Bk+i) and only 
look at functions of W = {Wi, ...,Wk). Let us take ¥?(i?", W) in to be 

^{R'', W) = I{ReA,W e B)I{R'' G C) 

where as in fl3.20p . R= [o^ ■ a'^')i^v<k is a k x k block in R"^. It is easy to check that with the 
choices we made, on the event C the terms that appear on the right hand side of (I2.2ip will 
become (recall fl3.18p ) 

n 

J2 a\ . . . , a") = E(/(i?i,2 = g*)) a, = (1 - C) E 

1=1 l<k l<k 

(exp F(a, a\ . . . , a"))_ = Wie""' + 1 - J] 1^, = /\^{W) 

l<k l<k 

and the first k coordinates of the map T{W) in f l2.20p are given by Ta{W). Therefore, f l2.2ip 
implies 

E(/(i? EA,We B)Ic) = E(/(i? G A, Ta{W) G B)IcZa{W)) (3.28) 
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where 

Z,{W) = A,(iy)-"exp(l - C) J]az 

l<k 

and using this for B = B^{w), 

Vc{R&A,W eBe{w)) ^ EjljR G A,Ta{W) E Beiw))IcZa{W)) 
Fc{W e B,{w)) nHTaiW) G B,{w))IcZ,{W)) ' 



(3.29) 



assuming that the numerator is not zero. By f l3.26p and the fact that T^^ = T_a we get that 
if Ta{W) G B^{w) then ZaiW) takes values in the set 



{A!!„(«;')exp(l -QY^ar.w'e B,{w)]. 



l<k 

Therefore, as £ — t- 0+, ZaiW) converges uniformly over such W to A"^(t(;) exp(l — C) J2i<k 
a constant, which will cancel out on the right hand side of fl3.29p and yield f l3.27p . 

□ 

Proof of Theorem IIOI Since the weights (vi) have Poisson-Dirichlet distribution PD{Q, 
using well known representations of the Poisson point process with intensity measure x~^~''dx 
and the corresponding representation of [vi) (see, e.g. Proposition 8 in [13]), one can easily 
check that the distribution of any finite subset of k weights is absolutely continuous with 
respect to the Lebesgue measure on M.^. This implies that the distribution of W in fl3.20p 
under Fc is also absolutely continuous with respect to the Lebesgue measure on M*^ since, 
on the event C, a^^ are all different for / < k. Let p{w) be the Lebesgue density of this 
distribution and let Pa^w) be the conditional expectation of I{R G A) given W under Fc- 
Then, for any measurable set on M^, 

FciReA,WeB)= / pAiw)p{w)dw, FdW e B) = / p{w)dw. (3.30) 

Jb Jb 

To prove f l3.22p . it is enough to show that Pa{w) is a constant a.e. on the set {w : p{w) > 0}. 
By the Lebesgue differentiation theorem, for almost every w' G M'^ one has (Corollary 1.6 in 

m) 

lim \pa{w)p{w) - pA{w')p{w')\dw = (3.31) 

6^0+ \Be{w')\ Jb,{ui') 

and 

hm — 1— / \p{w)-p{w')\dw = Q. (3.32) 

If Pa{w) is not a constant a.e. on {p{w) > 0} then we can find two points w',w" for which 
both fl3.3ip and (13.321) hold and such that p{w') , p{w") > and Pa{w') ^ pa{w"). We can 
also assume that w' , w" G Wk in flX^ since Fc{W ^ Wk) = 0. First of all, equations (K^ 
- flX^ imply that the left hand side of flXTTp 

hm ^ — — = pakw . 3.33 

£^0+ Fc{W G B,{w')) ' ^ ' 
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It is easy to check that if we take 



ai = log ^ - log i 

wl 1 — W{ — . . 



foTl<k then Ta{w") = w' for defined in ([321. Equations (Km and (Km imply that 

¥ciReA,WeT.Mw')) , . 

hm ^ — — — — — = vakw ). 3.34 

To finish the proof, we will follow the argument of Corollary 1.7 in [15] and use the fact 
that the sets T_a{Bs{w')) are of bounded eccentricity. Since all partial derivatives of Ta are 
uniformly bounded in a small neighborhood of w" and all partial derivatives of = T^a 
are uniformly bounded in a small neighborhood of w', there exist constants c,C > such 
that B^{w") C T_a{Be{w')) C Bceiw") for small e > 0. Therefore, 



IT. 



/p/ / bH -p(^w")\dw < ] I 

^a[Be[w'))\ JT.^i^BAw')) \Bce{.w")\ J b, 



\p(^w) — p(w")\dw 



\p{w) — p{w")\dw 



and using that (13.321) holds for w" implies 

^^^^ i-r (n ( I \p{w) - p{w")\dw = 

Similarly, using (I3.3ip for w" we get 



lim I I \pa{w)p(^w) - pA{w")p{w")\dw = 0. 



These equations together with (I3.30p for B = T^a{Bi,{w')) imply that 
and, recalling (I3.34p . we get Pa{w'^ = Pa^w") - a contradiction. 



□ 



Proof of Theorem |4l Let us fix m > 1. Let tt = (tti, . . . , vTm) denote the vector of indices 
corresponding to the m largest different weights among G(ct^), . . . , G(ct"). This assumes that 
the partition C defined before (I3.19P has at least m elements, so let us denote by Cm all such 
partitions. Recalling the vector J in (I3.20p . we can assume that if tt = / = (ii, . . . , im) then 
ii, . . . ,im & {ji, ■ ■ ■ ,jk} and let us denote this fact by writing I C where we made the 

dependence of J = J{C) on C explicit. Let us now also make the dependence of R = R'^ and 
W = W'^ in (Km on J explicit and let R^ = {a'' ■ a'^')i,i'<m and = {G{a''))i<m- Given 
a subset B C Wm, we can rewrite the event {tt = /, G B} in terms of W"^ by defining a 
set Bj C Wk such that 

{W-^ e Bi} = {W^ E B, is the vector of largest m weig hts in W-^}. 
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Then we can write 

E(/(i?" e A,w^ e B)) = J2 ^(HR^ e A,w^ e B^n = l)lc) 

ceCm icJ(c) 

= J2 Yl E{IiR' eAW' eBj)Ic) 

c&Cm icJ{c) 

(by Theorem [10]) = J] ^c{R^ ^ A)E{I{W^ e Bi)Ic). (3.35) 

cec™ /cJ(C) 

We will show in a second that Pc(-R^ ^ A) depends on C and I only through m and if we 
denote = {a^, . . . , a™' - all different} and = (cr' ■ (T^')i^i'<m then 

Pc(i?^ G A) = P^Ji?- G A) := ^a(i^"; ^-4)/,,J _ ^3 

Then, using (I3.36P in (I3.35P we get 

E(J(i?" eA,W^e B)) = IPdJR"" g A) E{I{W^ G fi)). 

When n gets large, with high probability the sample cx^, . . . , a" from G will contain points 
^1, . . . , corresponding to the largest weights f i, . . . , in G. Therefore, 

P((a ■ a')/,r<™ e A, (t;OK™ G 5) = lim E{I{R^ e A,^ e B)) 

n—>-oo 

= fD^iR"" G A) lim E(/(iy'^ G fi)) 

n— >oo 

= PD„(i?™ G A)Fi{vi)i<m e B). (3.37) 

This proves that {^i ■ iv)i^i'<m is independent of {yi)i<m and its distribution is invariant 
under permutations of coordinates since the distribution of R^ under P^)^ is obviously 
invariant under permutations of coordinates. It remains to explain why fl3.36p holds. Again, 
for simplicity of notation, suppose that / = {1, . . . , m) and J{C) = {1, . . . , A;}. Suppose first 
that k < n and assume, without loss of generality, that n E Ci - the element of the partition 
such that 1 G Ci. Let us denote by = C; n {1, . . . , n — 1} and define the event 

C' = {yi^l' <n- 1, Ri^v = q* <k such that /, /' G C^}. (3.38) 

Then, clearly, Ic = Ic'I{Ri,n = Q*) and (11. ip implies that 

E{I{R' G A)Ic) = E{I{R' G A)Ic'I{Ri,n = q*)) = ~ ^7 ^ E(/(i?^ G A)Ic,). 

n — I 

Similarly, 

E{Ic) = ^^'^~\~^ E{Ic') 
n — 1 

and, therefore, Fc{R^ e A) = Fc'{R^ G A). We can continue to remove coordinates outside 
of J{C) one by one until k = n. Once we are left with different configurations cr^, . . . , cr'^ we 
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can remove in a similar fashion coordinates with indices m + 1 , . . . , to finish the proof of 
f l3.36p , which competes the proof of Theorem HI 

p 

Identities for the Poisson-Dirichlet distribution. Finally, let us write down a couple 
of straightforward consequences of Theorems [1] and [5] for the Poisson-Dirichlet distribution 
PD{(). Due to a result of Talagrand that we mentioned above (see e.g. Section 1.2 in [16] or 
Theorem 15.2.1 in [2D]), the simplest measure for which the Ghirlanda-Guerra identities hold 
is the discrete measure concentrated on the orthonormal basis (cfc) with weights Vk = G{{ek}) 
from the Poisson-Dirichlet distribution PD{() for ( G (0, 1). First, let us write down what 
Theorem [1] says for this measure. Since the overlap now takes only two values and 1, 
any function of n configurations depends only on their partition into equal configurations. 
Therefore, we only need to write down what happens for any such particular partition. Given 
r > 1, let Ji, . . . , Jr be a partition of {1, ... , n} and let Up = \Ip\ for p < r. Let be the 

indicator of the set 

{{a\ . . . , a") : a^' = a^' ^ G Ip for some p<r}. (3.39) 

Since the overlap takes only two values, the most general choice of functions fj that we can 
make here is fj{x) = tjl{x = 1) for some tj G M. Since there is one-to-one correspondence 
between configurations in the set (13.391) and r different indices /i 7^ . . . 7^ G N such that 
= for j G Ip, we can rewrite (11.61) in terms of (f;^, . . . ,fi,,). Using (I3.18P and letting 
Sp = easily check that (II. 6p can be written as 

<^ ...<-■= E V -^^ — <^ . . . t;^. (3.40) 

For example, when n = 2, r = 2 and Ji = {1}, I2 = {2}, ti = —t2 = t, (I3.40p becomes 

VlVl' 



Notice that one can not take the formal limit t — > 00 on the right hand side for lack of 
integrability. To give another example, if in the notations of Theorem |5] we take r = 2, 
= {1}, J2 = {2}, h = f2 = tl{x < 1) and $ = 1 then (Q becomes 



EE 



i^il + e*(l - vi){vi + w + e*(l -vi- vr))) 



i> 



Similarly to (l3.4Up . one can also write down the general case of Theorem O for the Poisson- 
Dirichlet distribution, but we will omit the details here. 
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